Papers with ground-truth timing
Language-Driven Region Pointer Advancement for Controllable Image Captioning (2020.coling-main)
Copied to clipboard
| Challenge: | Controllable Image Captioning is a recent sub-task of Image Captions wherein constraints are placed on which regions in an image should be described in the generated natural language caption. |
| Approach: | They propose a method for predicting the timing of region pointer advancement by treating the advancement step as a natural part of the language structure via a NEXT-token. |
| Outcome: | The proposed method agrees with ground-truth timing in the Flickr30k Entities test data with a precision of 86.55% and a recall of 97.92%. |